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It is sliown iiow information contained in the pairwise correlations (in general, partial) between atoms of a 
gas can be used to completely convert heat taken from a thermostat into mechanical work in a process of 
relaxation of the system to its thermal equilibrium state. Both classical correlations and quantum correlations 
(entanglement) are considered. The amount of heat converted into work is proportional to the entropy defect 
of the initial state of the system. For fully correlated particles, in the case of entanglement the amount of 
work obtained per particle is twice as large as in the case of classical correlations. However, in the case of 
entanglement, the amount of work does not depend on the degree of correlation, in contrast to the case of 
classical correlations. The results explicitly demonstrate the equivalence relation between information and 
work for the case of two-particle correlations. 



The connection between work and information was first 
pointed out by Szilard[T] in his analysis of Maxwell's de- 
mon, and later by Landauer[2] and Bennett[3]. Using the 
setup of a "thought experiment" related to Gibbs's para- 
dox, it was shown[4l [5l [6] that using a system of two gases 
of molecules each, with the molecules being in different 
(in general, nonorthogonal) quantum states p^^^ and p'^'^\ 
it is possible to convert completely into mechanical work an 
amount of heat, taken from a thermostat, which is propor- 
tional to the entropy defect [7] of the system 

W = 2NkTIo, 

where W is work, T the temperature of the thermostat, and 
Iq the entropy defect (also called "quantum information" or 
"Levitin-Holevo bound" [U [9]) of the system per molecule, 
which, in this particular case, is 
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Entropy defect has the meaning of information (about the 
microstate of the system) associated with the selection of a 
subensemble (in this example, p^^^ or p*-^-') from the total 
ensemble p. 

It was conjectured[4l [Sj |6] that there exists a general 
equivalence relation between information and work; namely, 
that by having any information J about the state of a phys- 
ical system, it is possible, by allowing the system to relax 
to its maximum-entropy state, to convert into mechanical 
work an amount of heat W = kTJ without any entropy 
increase in the environment. (Of course, all information J 
is lost in the process, since the system reaches the thermal 
equilibrium state that has the same energy and volume as 
the initial state.) 

Since then, a number of papers (in particular, |10i lll[ 
[T2l [T3l [Ml [T5l [TBI [17]) has been devoted to various aspects 
of the connection between information and work. How- 
ever, the general equivalence relation remains up to now 
unproven. (Part of the problem, in our opinion, is the 
still existing fuzziness of distinction between "mechanical 
work" and "heat.") Moreover, all real-life examples of get- 
ting work from a non-equilibrium system (e.g., chemical re- 
actions, separated electrical charges, compressed gas) by 



allowing it to relax to equilibrium are based on the infor- 
mation contained in one-particle distributions — as if all the 
particles comprising the system were independent. To the 
best of our knowledge, information stored in multi-particle 
distributions has never been used to extract mechanical 
work. 

Here we address the problem of using information con- 
tained in two-particle correlations for converting heat into 
work. Our analysis is based on two important assumptions: 

1. Since a unitary transformation of the system's state 
does not change its entropy, it can be performed with- 
out any energy dissipation; and 

2. Since orthogonal quantum states are perfectly distin- 
guishable, there exist partitions which are permeable 
for one of such states but not for the other (a well- 
known example of such "partitions" is a light polar- 
izer). 

In order to avoid getting involved in definitional 
arguments — such as appear sometimes in the physics 
literature — concerning the distinction between work and 
heat, we shall consider an isothermal quasistatic process 
in which heat is taken from a thermostat and eventually 
transferred to another system in a form that is inequivo- 
cally mechanical work — namely, the lifting of a weight. 

We shall treat in separate sections the case when the 
two particles are classically correlated and that dealing with 
quantum correlations, and conclude with a discussion of the 
overall results. 



1 The case of classical correlations 

Consider a gas of molecules that consist of two different 
atoms, A and B. To each atom is associated a 2-dimensional 
Hilbert space of states with basis vectors |0) and |1) (a 
qu bit [18]). The thermal equilibrium (maximum-entropy) 
state of a gas molecule is described by a density matrix 



P2), with 



Pi = i(|00) (00| + |11>(11|), 
P2 = i(|01) (01| + |10)(10|). 
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States pi and p2 are orthogonal, and correspond to (classi- 
cally) maximally correlated atoms A and B. Each of these 
states has an entropy defect (in nats) /c = ln2 per pair, or 
Jc = A^ln2 for a gas of N molecules. Note that the one- 
particle probabilities of states |0) and |1) of both atoms are 
the same in states pi and p2 as at equilibrium. Therefore, it 
is impossible to distinguish between this state and the equi- 
librium state on the basis of one-particle measurements. 

Without loss of generality, assume we know that the gas is 
in state pi (let us call it gas 1). Let the gas occupy a vessel 
of volume 2V divided by a partition into two equal parts 
of volume V, each occupied by ^ molecules, and being in 
thermal contact with a thermostat at temperature T. To 
the gas on the right side of the partition apply a unitary 
transformation Ui = lyi €5 Us, where I a is the identity 
operator in the Hilbert space of A and the operator 
that interchanges states |0) and |1) of B — that is, the Pauli 
matrix ax- Transformation Ui converts gas 1 into a gas 
with density matrix p2 (gas 2). 

Now, replace the partition by two movable semiperme- 
able partitions such that the partition that faces gas 1 is 
permeable to gas 1 but not to gas 2, and vice versa for 
the other partition. Since the total pressure of the mixed 
gases is larger than the pressure of one of the gases, the two 
partitions will be pushed apart — and we can use the setup 
shown in Fig. [1] to lift weights mi and TO2. 
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Figure 1: Scheme for obtaining work by mixing gases. The 
excess pressure of the gases between the semipermeable par- 
titions pushes them apart and lifts weights mi and m2. 

Consider the moment when the right partition has ad- 
vanced to the right by a volume Vi and the left partition 
to the left by a volume V2. Gas 1 will then fill the volume 
y -|- Vi and gas 2 the volume V + ¥2- Let us assume that 
the gases are ideal and rarefied. Then the pressures of the 
gases to the left, to the right, and in between the partitions 
are, respectively, 

{N/2)kT {N/2)kT 
— ~Tr~~n~i ^2 = 



V + Vi 
_NkT^ 1 
2 V 



V + V2' 
1 



V + Vi V + V2 

The work produced by the gas by lifting masses of appro- 
priate weights in this quasistatic isothermal process is 

We = / (P,n - P2)dVi + / (P,n " Pi)dV2 = NkT In 2. 
Jo Jo 

Note that the total energy of the system has not changed 
in the process. Thus, the amount of heat converted into 
mechanical work is proportional to the entropy defect of 
the system, 

Wc = NkTh = kTJc. (1) 

By the end of the process the entire vessel is occupied by 
a mixture of gas 1 and gas 2 with density matrix p. The 



initial information about the location of each pair of atoms, 
contained in the correlation of states of the two atoms in a 
molecule, is now erased, and this increase in entropy exactly 
compensates for the decrease of entropy of the thermostat. 

Consider now the case of partial classical correlations, 
when each molecule is in a separable state 



Pip^f(lOO) (00| + |11>(11|) 



1-p 
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(101) (011 + 110) (101), 



where ^<p<l. (Ifp=^, the system is in the maximum- 
entropy — i.e., equilibrium — state, and no correlation ex- 
ists.) The complementary state is 



P2p 



-im (00| + |ll)(ll|) + i(|01) (011 + 110) (101), 



so that the equilibrium state is p = ^(pip + P2p)- Note 
that the marginal probabilities for each atom to be in state 
|0) or |1) are equal; thus, the deviation from equilibrium is 
entirely due to correlations. 

The entropy defect (per molecule) of the system is now 

I 2 

Icp = -Trplnp+ ■^'^T^'i^ Pip Inpip = ln2 - h{p), 

i=\ 

where /i(p) — — plnp— (1— p) ln(l— p) is the binary entropy 
function. 

Suppose the gas is in state pip (gas Ip). Using the same 
experimental setup as in the case of maximally correlated 
atoms, we apply the unitary transformation Ui to the gas 
on the right side of the partition. This transforms gas Ip 
into gas 2p with density matrix p2p- 

Now let us use exactly the same movable semipermeable 
partitions as before. Note that the partition that faces gas 
Ip performs in fact a measurement over the state pip, which 
results either in state p\ (with probability p) or p2 (with 
probability 1 — p) . Similarly, the partition that faces gas 
2p produces molecules in state p2 (with probability p), or 
in state pi (with probability 1 — p). As a result, the gas 
between the partitions has the maximum-entropy density 
matrix p. 

Initially, the total pressure of the mixed gases between 
the partitions is larger than the pressures of the gases to the 
left or to the right of both partitions. Hence the partitions 
are pushed apart as in the previous case, and the gases can 
produce work by lifting weights (Fig. [5]). Note, however, 
that the compositions of the gases beyond the partitions 
are changing in the process, owing to the filtering action of 
the partitions (we denote changing mixtures by gases (Ip)' 
and (2p)'). 
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Figure 2: Scheme for converting heat to work by mixing 
partially correlated gases. 

As before, let the right partition be moved to the right 
over a volume Vi, and the left partition to the left over a 
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volume V2. The pressures of the gases to the left, the right, 
and in between the partitions then become, respectively. 
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The partitions will stop moving when the pressures on the 
two sides of the partitions become equal, i.e., 

-Pip = Pnip = Pl-n- 



2p- 



Solving these equations, one obtains 

Vlmax = V'2max = (2p - l)V . 

Hence, the total work produced by the gas from the heat 
taken from the thermostat is 



{2p-l)V 



(2p-l)V 

(Pmp - Plv)dV2 

^0 

iVfcr(ln2 - h{p)) = NkTIcp. 



W^cp- / (Pmp - P2p)dVi 



(2) 



Note that by the end of the process all three parts of the 
entire vessel are occupied by gas in the equilibrium state p. 
Thus, the initial information (equal to the entropy defect) 
is expended in the conversion of heat into work. 

2 The case of quantum correlations 
(entanglement) 

Consider now the case where atoms forming a molecule are 
in a maximally entangled state. There are four such states 
of two qubits, namely, the Bell states[B] VE'"'', and 

defined as follows 
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$± = -=(|00)±|ll)), vi/± = (|01) ± |10)) 



V2 



V2' 



These four states are orthogonal and form a basis in the 
4-dimensional tensor-product Hilbert space of those two 
atoms. The entropy defect of the system in one of those 
states is /q = 2 In 2 per pair, or Jq = 2iVln2 for the whole 
gas (as before, we assume the gas to be ideal and the states 
of the molecules, independent). 

Suppose that the gas is initially in state Then, by use 
of the same transformation Ui as in the previous section, we 
can convert half of the gas molecules into state Using 
the same setup as in Fig.[TJ we obtain work Wi — NkTln 2; 
the final state of the gas will be a mixture 



i(|$+)($+| + |*+)(*+| 



Now we can use a unitary transformation U2 = U$(g)U^, 
where U$ is the unitary transformation that permutes $^ 
and $~ in the subspace spanned by these orthogonal states. 



and U^r analogously permutes and ^' 
U2 converts p*^^^ into a mixed state 



Transformation 



.(2) 



;(!$-) ($-1 + 1*-) (*-|). 



Note that states p*^^-' and p*^^-* are orthogonal, and thus 
perfectly distinguishable. 

Employing transformation U2 and using the same setup 
as before, we can now repeat the mixing procedure. This 
will yield additional work W2 = Nk\n2, bringing the sys- 
tem to the equilibrium state p = ^(p^^^ -I- p^^^)- Hence, the 
total amount of heat converted into work is 



Wq = 1^1 + T4^2 = 27Vfcrin2 = NkTI^ = kTJ^ 



(3) 



Since the entropy defect of the entangled states is two times 
as large as that of classically correlated states, the amount 
of work Wq is also larger than Wc by a factor of 2. 

Now assume that the gas molecules are initially in a pure 
partially entangled state 



1/; = a|00) +5|01) +c|10) + 



where 



(4) 



Conditions Q ensure that the one-particle density matri- 
ces are the same as at equilibrium. (Entanglement vanishes 
when p — State ^|J displays the same partial two-particle 
correlation as the mixed state pip. The important differ- 
ence is that in this case the correlation is entirely due to the 
entanglement. Thus, the two-particle system is in a pure 
state and its entropy defect is Iq = 2 In 2, independently of 
the parameter p. This leads to the paradoxical fact that 
the amount of work that can be obtained by the use of a 
gas in a partially entangled state is the same as in the case 
of maximally entangled state, namely. 



Wq = 2iVfcrin2 = NkTIq. 



(5) 



Indeed, state ip can be transformed by an appropriate uni- 
tary operator into state $+, and the procedure described 
above can be applied to convert to work an amount of heat 
equal to Wq. 

Expressions ([T]), ([2]), ([3|), and ^ present results related 
to the two extreme cases of entirely "classical" and entirely 
"quantum" correlations. One could consider a more general 
case of a mixed non-separable state, where the correlation 
is partially "quantum" (entanglement) and partially "clas- 
sical." The amount of work in this case should fall between 
the values given by ([2]) and ([3]). 

3 Conclusions 

The above results demonstrate the equivalence relation be- 
tween information and work for the case when the infor- 
mation is contained only in two-particle probability distri- 
butions, and cannot be extracted from a mere one-particle 
distribution. 
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The situation with the equivalence between information 
and work in general remains unclear and, in a way, paradox- 
ical. On one hand, many researchers are strongly convinced 
of it and express it in a very firm way, e.g., "Information 
has an energetic value: It can be converted into work" 
(Zureck[Tl]; but cf. [H]). (In fact, it is not information that 
can be converted into work, but heat that can be converted 
into work by use of information.) On the other hand, in 
our opinion, one still lacks a convincing general proof that 
any kind of information can be equally successfully used 
to convert heat into any kind of work, so that the general 
statement remains a sort of "folk theorem." We believe that 
the root of this problem is the fact that, in spite of many un- 
questionable examples of "work" known to physicists, there 
is no general rigorous definition that would distinguish be- 
tween these two forms of energy transfer — heat and work. 

Informally speaking, work is an "informed" transfer of en- 
ergy, i.e., a transfer such that we know exactly the change 
of the state of each degree of freedom, resulting from this 
transfer; while heat is energy transfered in such a way 
that we have no such knowledge. From that viewpoint, 
the equivalence between information and work becomes in- 
deed a tautology. However, a rigorous formalization of these 
ideas has not yet been presented. 
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